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density change into consideration and an expansion condition (equation (4)) taking the global density change into 
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REGION EXTRACTING METHOD AND THREE-DIMENSIONAL DISPLAY METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates to a method of automatically performing, in respect of individual internal 

organs, a region extraction processing (hereinafter the region extraction processing (hereinafter the region 
5 extraction processing for individual internal organs will be referred to as "internal organ extraction") needed 

as pre-processing when each internal organ is displayed three-dimensionally by using in-body image data, 

especially, a tomography image which is imaged three-dimensionally. 

In order to display a specified internal organ three-dimensionally, the internal organ must first be 

extracted from image data. However, any method of performing the internal organ extraction automatically 
70 has not been established yet and for accurate extraction, a contour of the intemal organ must be inputted 

manually in respect of each slice image. However, the amount of three-dimensional data is very large and 

therefore, in the clinical spot requiring real time performance, the manual internal organ extraction is 

unpractical. 

Two approaches to the general method for region extraction have been contrived including: 
15 (1) A method of tracking the contour of a region of interest (hereinafter abbreviated as an ROI) 
(2) A method of performing the region expansion by starting from a point inside an ROI. 
The method in item (1) above is for automatically tracking the contour of an internal organ by looking 
up a local density difference of an image and has hitherto been used widely in the medical image 
processing- An example of this method is discussed in Radiology. April. 1989, pp. 277-280. This type of 
20 method of tracking one line is however, liable to be fatally affected by noise and artifact, facing a problem 
of impairment of reliability. In addition, the method is carried out by merely processing the slice sheet by 
sheet and fails to effectively utilize data of three-dimensional structure. 

The method in item (2) above is for extracting an ROI by first selecting a certain point inside the ROI. 
retrieving a point connecting to the selected point from adjoining pixels, and taking in the connected point to 
25 expand the ROI. In general, this method is called region growing and referred to in "Digital Picture 
Processing" by Azriel Rosenfeld, Pages 334 and 335. Typically used as the condition for deciding the 
connection (hereinafter referred to as the expansion condition) is the difference between average density 
over the entire region and density of a tracking point. The prior art method finds many applications to, for 
example, character pattern extraction but is hardly applied to the internal organ extraction because good 
30 results can not be obtained when the method is applied by simply using the above condition for medical 
images having sophisticated forms and density changes. 

SUMMARY OF THE INVENTION 

35 

An object of the invention is to achieve the interna! organ extraction of sufficiently high reliability which 
can automatic the region extraction processing as far as possible by effectively utilizing data of three- 
dimensional structure. 

In a method according to the present invention, with the view of effectively utilizing the three- 
40 dimensional data, the method based on the region expansion in item (2) above is used as a basic 
technique. In this case, as described previously it is a matter of importance how the expansion condition for 
accurately determining a region range can be set. According to the present Invention, two different 
conditions, of which one takes local density changes Into consideration and the other takes global density 
changes Into consideration, are considered as the expansion condition and used in combination to realize 
45 the region extraction of higher reliability. Further, an expedient is taken in which the results of region 
extraction are added with regions adjacent to the boundary of an extracted region to minimize the oversight 
of extraction. 

so BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic block diagram illustrating a system to which the invention is applied; 

Fog. 2 is a diagram showing MRI slice images and three-dimensional data constructed to the image; 

Fig. 3 Is a flow chart for implementation of an embodiment of the invention; 

Figs. 4A to 4C are graphs useful to explain the limitation to region expansion due to local and global 
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density changes; 

Rgs. 5A and 5B are diagrammatic representations useful to explain the region expansion processing 
conducted after the region extraction: 

Rg. 6 is a detailed flow chart of the region expansion processing; 
5 Figs. 7A and 7B are diagrams illustrating pixels adjacent to a "parent" which can be permitted to behave 
as "children" upon region expansion; 

Rgs. 8A to 8E are diagrams showing how the region expansion is carried out; 
Rgs. 9A to 9F are diagrams showing examples of storage of voxel attribute information; 
Fig. 10 is a flow chart of an example of application of the invention; and 
10 Figs. 11 A to lie are diagrams useful in explaining an extracting method according to a modified 
embodiment of the invention wherein the constraint condition is changed in accordance with features of a 
region. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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Prior to describing specific embodiments of the invention, the principle thereof will be described, the 
region expansion taking the local density change into consideration will first be described. Normally, the 
density value changes greatly at the boundary of an internal organ. The principle on which the region 
extraction using the local density change as the constraint condition for the region expansion is to recognize 
20 a change in density value at the boundary so as to perform the region extraction. Specifically, when the 
change in density value at the boundary exceeds a constant value a, the region expansion is stopped. On 
the assumption that the local region is confined within a range of one dot. the condition for permitting the 
region expansion is expressed by the following formula: 

26 where fs is a density value at an expanded region point i, and f|.i is a density value at a point which one 
point precedes the expanded region point i. 

However, it is infrequent that the boundary is confined within the narrow range of one dot and normally, 
the boundary lies over a range of several dots. In such a case, the confinement of the locai region within the 
range of one dot is considered to be practically unsatisfactory and the following formula, i.e.. expansion of 

30 the aforementioned formula Is used: 

|f,.f,,|<ann = 1.2. ...,N (2) . . r 

where N is the number of dots defining the vicinity. fi.n is a density value at a coordinate point which lies on 
the region expansion path and n dots precedes the expanded region point, and an is a criterion of the 
expansion condition which is set between two dots having an internal of n dots. 

35 Criteria ai , a2. .... are so set as to satisfy the following formula: 

ay ^ az ^ ^ocN (3). 

When only the locai density change is used as the expansion condition, a problem arises it the 
boundary of an internal organ is not clear. If in such an event the expansion condition is relieved, not only 
an adjacent internal organ but also the background tends to be contained in an extracted region. 
40 Now. the region expansion taking the global density change into account will be described. 

In this method, the operator first surveys the entire image in order to designate a representative point of 
an extraction region. Then extraction is carried out by looking up a density of at the representative point (or 
vicinity average), a density fj at an expanding point and a preset parameter ^. under the constraint condition 
for region expansion defined by the following formula: 

45 |fi - fo|< 0 W . r . . 

This method presupposes that the density is substantially the same throughout the interior of a single 
internal organ. However, validity of this presupposition is limited to recognition of bones and soft parts or 
tissues in X-ray CT imaging, and in the case of MRI. a change in composition is sensitively reflected even 
in the same soft part or tissue and therefore it is difficult to achieve proper region extraction under only the 

so above expansion condition. 

As described above, achievement of satisfactory region extraction is not expected by the exclusive use 
of either of the two methods. But the two methods may be used in combination for extraction so that the 
two can be carried out so as to mutually compensate for their disadvantages, thereby permitting more 
accurate region extraction. 

55 In the combined method, the expansion condition is defined by weighting the expansion conditions in 
the two methods and expressed by the following formula: 
ax|f|-fM| + bxlf|-fo|< 7 (5) 

where a and b are weights and 7 is the composite intensity of expansion condition. 
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Finally, the results of the region expansion conducted under the above condition may be added with a 
region adjacent to the region boundary to attain the effect to be described below. 

For example, in medical images, the boundary of an internal organ is usually blurred so It can not be 
identified definitely as either the interior or the exterior of the internal organ. If definitely Identified, large 
5 errors will be contained in data representative of the boundary of the region. Since the three-dimensional 
display of an internal organ is eventually done in terms of a form of the surface of the internal organ (i.e., 
region boundary), it is necessary to contrive how to suppress the errors to the minimum. 

According to the invention, the region extraction is first carried out through the aforementioned region 
expansion and thereafter a slight amount of regions subject to smoothing are added to an extracted region 
10 In order that the entirety of an internal organ to be displayed can be confined completely within the 
extraction region. This method may presumably has a disadvantage that regions outside the object region 
may possibly be included in the extraction region but the advantage of perfect inclusion of regions to be 
extracted can overcome the disadvantage. Especially, in the three-dimensional display based on volume 
rendering, a portion of low density is reflected on an image and therefore the image quality, greatly changes 
15 depending on whether this low-density region is included or not. 

The invention will now be described using specific embodiments with reference to Rgs. 1 to 10 and 
Figs. 1lAto 11C. 

Fig. 1 is a block diagram showing a system to which the invention is applied. 

Referring to Fig. 1. an input/output I/O unit 10 exchanges images between a tomography imaging 
20 system such as X-ray CT or MRI and memories 11, 12, 

The memory 11 stores tomography images received from the 1/0 unit 10. At that time, the tomography 
images are stacked on each other while being helt in correct spatial relationship, to obtain three-dimensional 
data which Is stored. Fig. 2 shows the concept of this procedure. More particularly tomography images, one 
of which is illustrated at (a) in Fig. 2, are stacked sheet by sheet in the orderly manner as shown at (b) In 
25 Fig. 2 to provide a three-dimensional structure of head (for example, the epidermis indicated at dotted line 
15 in Fig. 2). 

Stored in the memory 12 are the results of region extraction obtained for an original image in the 
memory 11. 

Under the control of a central processing unit (CPU) 13, the region extraction is first carried out for data 
30 in the memory 11, the results of extraction are stored In the memory 12, and a three-dimensional Image of 
a specified region is prepared using the data in the memories 11 and 12. 

A display unit (CRT) 14 displays the three-dimensional image prepared under the direction of the CPU 
13. The CRT is also used to check the original data and the region extraction procedure. 

Fig. 3 Is a flow chart showing the processing procedure in the CPU 13. The procedure for extracting a 
35 cerebral cortex region by using an MRI image of head will be described in accordance with the flow chart of 
Rg. 3. 



<Step 100> 

40 

A plurality of tomography data sheets obtained from MRI are inputted through the I/O unit 10 and 
stacked on the memory 11. As result, the data on the memory 11 has a three-dimensional structure. 



45 <Step101> 

Looking up individual tomography images of the 3-D data stacked in the memory 11, the operator 
designates coordinates of a point (single or plural) inside an internal organ to be extracted. The thus 
designated point Is a start point of region expansion (hereinafter this point will be referred to as "start point" 
50 and the region expansion will be described by referring to the following steps 103 and 111 to 122). 

In the above, the start point is manually set but It may be set automatically by acquiring in advance 
information concerning approximate position, form or shape and density of each internal organ and 
conducting comparative calculation between the information and features of each internal organ in the 
original image. 

55 

<Step 102> 
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In the present region extraction nnethod, the region expansion is linnited by the magnitudes of local and 
global density changes. The intensity of the constraint condition is determined by two kinds of parameters 
inputted in this step, that is. a local parameter corresponding to the local density change and a global 
parameter corresponding to the global density change. The smaller the value of any of these parameters. 

5 the stricter the condition for region expansion becomes. 

Whether the parameters are optimum or not is evaluated after completion of a practical extraction 
processing by displaying some of sequential slices simultaneously or by actually preparing a three- 
dimensional image from the results of extraction. In the event that the extraction ends midway or the 
extraction goes beyond a region to be extracted, the local parameter or the global parameter is changed 

70 and thereafter the extraction processing resumes. 
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<Step 103> 

The region extraction beginning with the start point designated in step 101 is carried out by using the 
local and global parameters inputted In step 102 as the constraint condition for region expansion. Figs. 4A 
to 4C show how the region expansion Is limited by these parameters. 

Fig. 4A is a graph useful to explain the region expansion limitation due to local density change. 
For explanation convenience sake, the region expansion is so limited as to be conducted in one- 
20 dimensional direction. ^ 

Referring to Fig. 4A. the density changes greatly between a 9-th point (hereinafter represented by P9 ) 
and P10 on abscissa. Since this large density change is considered to occur at the boundary of an internal 
organ, the region extension is stopped at P9 and the extraction region is determined as extending from PO 
to P9. 

25 When the region expansion is carried out under the above condition the following formula stands: 

where fj is a density value at an expanded point, fj.i is a density value at a point which one point precedes 
the expanded point and a is a local parameter. 

Fig. 4B is a graph useful to explain the region expansion limitation due to global density change. 
30 In Fig. 4B. the density difference as referenced to the start point exceeds a preset value ^ at P8. 
Normally, since the pixel value (the density value of pixel) inside an interna! graph is considered to fall 
within a certain range of density, the region expansion is stopped at P7 which exceeds the range and the 
extraction region is determined as extending from PO to P7. 

When the region expansion is carried out under the above condition, the following formula stands: 

35 |fi - fol < J9 

where fo is a density value at the start point and 0 is a global parameter. 

Fig. 4C is a graph useful to explain the region expansion condition defined by using the focal and global 
density changes in combination. 

Referring to Fig. 4C. the density difference as referenced to the start point exceeds a preset range at 
P4. However, a local density change preceding P4 Is not so large that the region expansion is permitted to 
continue. Conversely, the local density changes greatly between P7 and P8 in Fig. 4C but the density 
difference as referenced to the start point is sufficiently small at P8, with the result that the region 
expansion is still permitted to continue. The local and global density differences are both large in 
association with PIO and the region expansion is stopped at P10. 

As described above, with the local and global density changes used in combination, even when one of 
the two changes slightly exceeds the range of expansion condition, the region expansion is permitted to 
continue if the other satisfies the expansion condition sufficiently. Therefore, the region expansion can be 
effected with higher flexibility. The condition for this region expansion is expressed by the following formula: 

ax|f|-fM| + bx|f, -fo|< c . u ^ 

where a and b are weights applied to the expansion conditions of the local and global density changes, and 
c is the composite intensity of constraint on the composite expansion condition. 

The region expansion will be described in greater detail by referring to steps 111 to 122. 
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50 



55 <Step 104> 



In order that the entire region to be displayed can be included in the extraction region, the results of 
region extraction obtained in step 103 are added with a region corresponding to several dots. 
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Figs. 5A and- 5B are diagrammatic representations useful in explaining the enlargement processing. 
In particular, Fig. 5A depicts two adjoining regions A and B, the latter being designated by 512. and Fig. 
58 graphically shows a density profile taken on line I of Fig. 5A. The procedure will be described on the 
assumption that the region A is an object to be extracted. 

5 Of the region A shown in Fig. 5A. a region Ao contoured by solid curve 510 is the region extracted in 
the procedure of steps 100 to 103. As will be seen from Rg. 58. the region Ao in trudes greatly into the 
region A to be extracted. However, for complete inclusion of the entirety of the region A, the extraction 
range must be extended to a portion of considerably low density value and to this end, the expansion 
condition has to be relieved to a great extent. In this case, however, the extraction region will extend 

10 inconveniently, reaching a different region or the background. In the present step of region adding 
processing, a region a' surrounding Ao and having a dotted contour 51 1 is added to the extracted region to 
approximate the extraction region to the region A more closely. Essentially, the region A is a mere region 
of low density but the presence or absence of this region plays an important role in improving the quality of 
three-dimensional image to be prepared through volume rendering. 

75 The above region adding processing can be effected by, for example, applying a snnoothing processing 
to the extracted region as Indicated by the following formulas. 

More particularly, the image obtained through the steps 100 to 103 is a binary image (go (x, y, z)) which 
IS "1" inside the region and "0" outside the region but when this binary image is applied with the 
smoothing processing, the extraction image data is represented by a multi-value image (gi (x, y, z)) which 

20 takes a value of 0 (zero) to 1 In the vicinity of the boundary. 
gi(x, y, z) = 1 

... when go(x, y, z) = 1 (inside the region) 

1 +1 +1 +1 
25 gi(x, y, z) = -rr- E Z Z g^(x+Ax, y+Ay, z+Az) 

Ax=-1 Ay=-1 Az=-1 



... when go(x, y, z) = 0 (outside the region) 
<Step 105> 

Individual pixels of the extraction image data obtained through the steps 100 to 104 are multiplied by 
individual pixels of the original image data to provide an image indicative of only a specified region 
extracted from the original image. 



<Step 106> 

The extraction image obtained in the preceding step is subjected to the three-dimensional display 
processing (rendering) to provide a three-dimensional image of a specified internal organ. 

The procedure of region expansion processing in the step 103 will now be described in greater detail 
with reference to a flow chart of Fig. 6. In describing the region expansion, the original or start point of 
expansion will be hereinafter called a "parent" and a point expanded from the original point will be called a 
"child". Figs. 8A to 8E show in sequence how "parent" and "child" take place on a practical image and 
how a region is expanded. 



<Step111> 7 

The memory for storage of the extraction region (memory 12 in Fig. 1) and "parent table" and "child 
table" for storing coordinates of "parent" and "child" are initialized. The tables are comprised in the main 
memory within the CPU 13. 



<Step 112> 
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The "start point" inputted in step 102 is registered as an initial "parent" In the "parent table". 
<Step 11 3> 

One of the "parents" registered in the parent table is taken out and processings in the following steps 
1 1 4 to 11 8 are carried out. 

10 <Step114> 

One of pixels adjacent to the "parent" (taken out in the preceding step 113 is taken out and 
processings in the following steps 115 to 117 are carried out. 

(The expression "pixels adjacent to a parent" signifies four pixels adjoining sides of a parent as shown 
IS in Fig. 7A when the region extraction is carried out In two-dimensional space and six pixels adjoining planes 
of a parent as shown In Fig. 7B when the region extraction is done in three-dimensional space.) 



<Step 115> 



20 



It is evaluated whether the "pixels adjacent to a parent" taken out in the preceding step 114 can behave 
as "children". Behaving as "children" can be permitted when the following conditions are satisfied: 

(1) The evaluation of the pixel was not done in the past (step 115) 

(2) The expansion condition (local and global) is satisfied (step 116), 

25 If behaving as "child" Is permitted, the program proceeds to the following step 116 but unless 
permitted, the program jumps to step 118. 



30 



35 



<Step 116> 

The adjacent pixel is registered as a "child" in the "child" table. 
<Step117> 



A point representative of the "child" is written in the extraction region storage memory (memory 12 in 
Fig. 1) 

40 <Steplia> 

If the evaluation of "pixels adjacent to a parent" is completed for ail pixels, the program proceeds to the 
next step but if not the program returns to step 114 where the "pixels adjacent to a parent" evaluation is 
done for another pixel. 

45 

<Step 119> 

The "parent" which has been an obiect to be evaluated throughout the steps following step 113 is 
50 erased from the "parent table". 

<Step 120> 

55 The "parent table" is looked up to examine whether a "parent" remains. If there is a remaining parent, 
the program returns to step 1 13 but if not. the program proceeds to the next step. 
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<Step 121> 

The "child table" is looked up to examine whether a "child" has been prepared. If not. the program 
ends. 

5 

<Step 122> 

The contents of the "child table" is transferred to the "parent table". Namely, prepared "children" are 
10 all newly registered as "parents". Thereafter, the "child table" is Initialized and the program again returns to 
step 1 1 3. 

Modifications of the foregoing embodiment will now be described. 



75 [First modification] 

The extraction processing described in connection with the foregoing embodiment is effected for each 
internal organ and the results are stored as attribute information of a voxel (indicating which internal organ 
region the voxel belongs to) in the memory along with the density information. 
20 Further, on the basis of the thus obtained attribute information of voxel, each internal organ is 
selectively accessed and displayed. 

Conceivably, the attribute information of voxel may be stored in various ways. Referring to Fig. 9A. a 
cube 910 is a three-dimensional array for storing the results of extraction and a cube 911 is one of voxels 
within the array which stores data as to which region the corresponding pixel belongs to. Various kinds of 
25 the data and the manner of storing the data will now be described with reference to Figs. 9B to 9F. 

In Fig. 9B, the extraction results are represented by only information of bit 912 and only information 
about the interior/exterior of a region corresponding to an internal organ is stored. 

In Fig. 9C. the probability, as designated by 913. that a certain region may exist at a position of interest 
is available. When subjected to the three-dimensional display method such as volume rendering, this data 
30 may be used for imaging parts or tissues with reality. 

In Fig. 9D, the kind of each internal organ, which has been extracted. Is represented by an internal 
organ code 914 and the probability of its existence 913 is available. A specified internal organ can be 
displayed by looking up Its internal organ code. 

In Fig. 9E, there is available a field for storing the kind of internal organ as in the case of Fig. 9D but 
35 differently, the field of Fig. 9E has the form of a bit string 915. Individual bits indicate the presence or 
absence of Individual internal organ. This fomnat can designate an internal organ to be displayed through 
simple bit operation and is therefore suitable for speed-up In the display system. 

In Fig. 9F. the probability of existence 916. 917. 918 or 919 of each internal organ is available. Although 
the data length is Prolonged, the format of Fig. 9F may be applied effectively to a region such as the 
40 boundary of internal organ in which it is not always determined definitely which region a voxel belongs to. 



[Second modification] 

45 A modified embodiment wherein the method of the foregoing embodiment is carried out a plurality of 
times by using different parameters for respective cycles will be described with reference to a flow chart of 
Rg. 10. 



50 <Step 301 > 

An array for storing the number of extraction operations is initialized. 



55 <Step 302> 

Local and global expansion conditions are set. In the present modification, the extraction processing is 
executed a plurality of times by relieving the conditions gradually. Thus in order to avoid a region to be 
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extracted from being included perfectly through the first cycle of extraction processing, parameters are so 
set as to make the expansion conditions slightly stringent. 



5 <Step 303> 

The region extraction processing is carried out in accordance with the method described in connection 
with the foregoing embodiment. 

10 

<Step 304> 

The results of extraction obtained in step 303 corresponds to part of the region to be extracted. The 
value of the extraction cycle count array is incremented by one. 

15 

<Step 305> 

The results of extraction are examined. If the region to be extracted is completely included in the 
20 extraction results, the program proceeds to step 307 and the extraction cycle count array is evaluated. If 
part of the region to be extracted still remains, the program proceeds to the following step 306. 



<Step 306> 

25 

The expansion parameter Is changed to sightly relieve the expansion conditions and subsequently, the 
program again returns to step 303 to perform the extraction processing. 



30 <Step 307> 

A certain extraction region can be obtained by clamping the count array at an appropriate threshold 
value. By setting the threshold value properly while monitoring the extraction region on the display unit, the 
internal organ extraction can be performed with higher reliability. 

35 

[Third modification] 

In the present modification, the region extraction is carried out while changing the expansion constraint 
40 conditions, which remain unchanged constantly in the foregoing embodiment, in accordance with features of 
an object region. More specifically, local constraint condition and global constraint condition depending on 
values and position information for several sampling points set up in a region to be extracted are calculated 
and the region expansion is effected on the basis of these conditions. Figs.- 11 A to 11C are useful to explain 
the method of the present modification, 
45 Referring to Fig. 11 A. P1{xi. yi) and P2(X2. yz) represent sampling points set up in an object region 
1110 to be extracted and P(x, y) represents a point (expanded point) being evaluated as to whether to fall 
within the present region. 

At the expanded point P. the global constraint condition is given by the following formula: 

|f, - fo| < jS. 

50 While in the foregoing embodiment fo always indicates the density value at the start point, that is. takes 
a constant value, fo in the present modification is calculated in respect of individual expanded points 
pursuant to the following formulas 



55 
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9 



= J (x-x^)2 + (y-y^)^ 



vyhere fi and f2 represent density values at PI and P2. respectively. 

Referring to Fig. 11B. a hatched area 1112 Indicates a density range within which the global expansion 
condition is satisfied. In the vicinity of the sampling point PI , the expansion condition is satisfied within a 
width range of 2j9 centered on fi but in the vicinity of the point P2, within a width range of 2^ centered on 
f2. At the expanded point P, the density range satisfying the expansion condition coincides with a line 
segment 1113 with arrows. 

The local constraint condition at the expanded point P is given by the following fornnula: 

|fi - f|.i| < «. 

The parameter a is constant in the foregoing embodiment but in the present modification it is calculated 
in respect of individual expanded points pursuant to the following formula: 



where fo is a value obtained at a point under the global expansion condition, and ao is a local parameter 
standing for a criterion. 

Referring to Fig. 11C, ordinate represents the density difference between adjacent pixels and a hatched 
area 1114 indicates a range within which the local expansion condition is satisfied. In the vicinity of P1 at 
which the density value is high, the tolerance of the density difference becomes high but in the vicinity of 
P2 at which the density value is low, it becomes low. At the expanded point P. the expansion condition is 
satisfied within a range Indicated by a line segment 1115. 

Conventionally, the tissue extraction processing for a specified internal organ has been very laborious 
and time-consuming but by using the present invention, most of the processing can be autonnated. Further, 
the method of the present invention has good compatibility with the volume rendering which is one of 
methods for three-dimensional display of voxel data and therefore a three-dimensional image of a specified 
internal organ can be prepared easily by applying the volume rendering to the results of extraction of the 
corresponding region. Especially, three-dimensional display of soft parts (for example, cerebral cortex), 
conventionally difficult to achieve, can be ensured. 



1 . A region extracting method comprising the steps of: . 

preparing (100) a multi-dimensional Image data by combining two or more two-dimensional tomography 
image data sheets; 

detecting (102) at least two kinds of features representative of a local change and a global change in a pixel 
value by using the prepared data; 

calculating (102) a composite feature which is a combination of said features; 

performing (103) a region expansion by using said composite feature as the condition for expansion; and 
adding to data (Ao) prepared through said region expansion a region (a') surrounding said data. 

2. A region extracting method according to Claim 1 , wherein said step of performing a region expansion 
includes selecting a pixel acting as a representative point of a region of interest, and sequentially expanding 
the region toward a pixel adjacent to said representative pixel by using said representative pixel as a start 
point (fo) of region expansion. 




a = 




Claims 



10 



EP0 424 912 A2 



3 A region extracting method according to Claim 1. wherein said step of calculating a composite feature 
includes determining features of a region of interest, weighting (a. b) said two l<inds of features in 
accordance with the features of said region of interest, and adding together the weighted features. 

4 A region e)ctracting method according to Claim 1, wherein said step of performing a region expansion 
5 Includes defining, as said global change, a difference between an average of values of pixels in the vicinity 

of said start point and a value of a pixel subject to region expansion, and using, as one of feature expansion 
conditions, the fact that the difference falls within a range defined by a predeterminedly designated set 
value (/3). 

5. A region extracting method according to Claim 1. wherein said step of performing a region expansion 
10 Includes defining, as said local change, a change in value of a pixel inside a region in the vicinity of a point 

subject to region expansion, and using, as one of region expansion conditions, the fact that said change 
value falls within a range defined by a predeterminedly designated set value (o). 

6. A region extracting method according to Claim 1. wherein said step of performing a region expansion 
includes looking up features of individual internal organs to automatically set coordinates of said start point 

15 and setting values (fo) in accordance with an internal organ to be extracted. 

7. A region extracting method according to Claim 1. wherein said step of performing a region expansion 
includes performing the region expansion by changing the local and global constraint conditions in 
accordance with imaging conditions and features of a region to be extracted. 

8. A region extracting method according to Claim 1 . wherein said step of performing a region expansion 
20 includes executing extraction of a region of interest a plurality of times in respect of the same image data 

by using at least two or more different local and global constraint conditions and calculating the number by 
which each pixel is extracted, and determining the ultimate range of region extraction on the basis of the 
calculated number. 

9. A region extracting method according to Claim 1, wherein said step of performing a region expansion 
25 includes adding a region (A) of one or more dots around the extracted region (Ao) obtained through said 

region expansion, and weighting said added region in accordance with the distance from the region 
boundary. . 

10. A region extracting method according to Claim 9, wherein said steps of adding dots and weighting said 
added region are effected by repeating a processing indicated by the following formulas when n- 

30 dimensional data is used: 

gi(Xi.X2. .... Xn) = 1 

... when g (Xi.X2. .... x„) « 1 (Inside the region) 



35 



40 



+1 +1 +1 

E ... E 



... when go(xi ,X2 x„) = 0 (outside the region) 

where go (xi. xz Xn) is image data obtained through region expansion and^is 1 (one) for the interior of 

the region and 0 (zero) for the exterior of the region. 
.45 11. A region extracting method according to Claim 10. wherein said weighted region extraction data is 
multiplied by said multi-dimensional image data in respect of individual pixels to reflect the density of the 
original image on the extraction region. 

12. A region extracting method comprising the steps of: 

applying extraction of internal organ based on region expansion to a plurality of organs to obtain region 
50 extraction data In respect of Individual internal organs; and 

storing the region extraction data In part of three-dimensional image data or in a three-dimensional array 

(910). 

13. A region extracting method according to Claim 12. wherein said step of storing the region extraction 
data includes storing the region extraction data for each internal organ in the form of any one of a code 

S5 (912) corresponding to each internal organ, a bit string (915) containing bits corresponding to individual 
internal organs and the probability (916 - 919) of existence of each internal organ. 

14. A three-dimensional display method comprising the steps of: 
extracting a specified region through region expansion; and 
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applying a three-dimensional image preparing method based on volume rendering to said specified region 
to construct a three-dimensional image. 

15. A three-dimensional display method according to Claim 14, wherein said step of extracting a specified 
region includes changing pixel values In a region to be displayed and in a region not to be displayed within 
an original image by using region extraction data. 
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@ In order to ensure that region extraction for ex- 
tracting a specified internal organ can be effected 
with high reliability a region expansion method is 
applied by using an expansion condition (equation 
(1)) taking the local density change into consider- 
ation and an expansion condition (equation (4)) tak- 
ing the global density change into consideration in 
combination. 
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